ALGEBRAIC AND DYNAMIC LYAPUNOV EQUATIONS 
ON TIME SCALES* 
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Abstract. We revisit the canonical continuous-time and discrete-time matrix algebraic and ma- 
trix differential equations that play a central role in Lyapunov based stability arguments. The 
goal is to generalize and extend these types of equations and subsequent analysis to dynamical 
systems on domains other than M or Z, e.g. nonuniform discrete domains or domains consisting of 
a mixture of discrete and continuous components. We compare and contrast the standard theory 
with the theory in this general case. 
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1. Lyapunov Equations and Stability 

One of the most widely used tools for investigating the stability of linear systems is the Second 
(Direct) Method of Lyapunov, presented in his dissertation of 1892. The idea of this method is 
to investigate stability of a given system by measuring the rate of change of the energy of the 
system. The advantage of this approach is that it allows one to infer the stability of differential (and 
difference) equations without explicit knowledge of solutions. 

We begin with a review of Lyapunov's Second (Direct) Method in the context of linear differ- 
ential equations on M and linear difference equations on Z. Then, building on the work of DaCunha 
[5] we proceed to unify and extend this well known theory for application to dynamic linear systems 
defined on arbitrary time scale domains. 

Specifically, DaCunha extended Lyapunov's Second (Direct) Method for application to stability 
analysis of certain classes of dynamic systems (e.g., slowly time varying systems) and developed 
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and solved a time scale algebraic Lyapunov equation. Here we develop and solve a dynamic time 
scale Lyapunov equation which has application to the stability analysis of a much broader class of 
systems. 

2. Stability of Continuous-time Systems 
We begin by considering the familiar linear state equation 

i{t) = A{t)x{t), (2.1) 
for A G M"^", and f G M. We assume that ( |2.1[ ) has equilibrium x — 0. There are various notions of 



stability of solutions to (2.1 1, which we outline now. Without loss of generality, we take the origin 



as the reference equilibrium. 



Definition 2.1. An equilibrium a; = of (2.1 1 is Lyapunov stable or stable in the sense of Lyapunov 
if, for every e > 0, there exists a (5 = (5(e) > such that if ||x(to)|| < 5, then ||a;(t)|| < e for every 
t>to. 



Definition 2.2. An equilibrium a; = of (2.1 1 is called uniformly stable if there exists a finite 
positive constant 7 such that for any to and xq the corresponding solution satisfies 

Mt)\\<-f\\xo\\, t>to. 



Definition 2.3. An equilibrium x = of (2.1 ) is asymptotically stable if it is Lyapunov stable and 



there exists a, S > such that if ||x(io)|| < S, then linit^oo ||2;(i)|| = 0. Furthermore, an equilibrium 



X = of (2.1 ) is uniformly asymptotically stable if it is uniformly stable and if given any S > 0, there 
exists a T such that for any to and xq the corresponding solution satisfies 

\\xm < S\\xo\l t>to + T. 

Definition 2.4. An equilibrium x — of ( |2.1| is exponentially stable if it is asymptotically stable 
and there exist constants 7, A, (5 > such that if ||a;(to)|| < S, then 

||x(t)|| <7e-^(*-*")||x(io)||, t>to. 



Furthermore, 2: = of (2.1 1 is uniformly exponentially stable if there exist 7, A > such that for any 
to and Xq the corresponding solution satisfies 

||x(t)||<7e-^(*-*»)||x(io)ll, t>to. 

It is important to note that, in the context of linear systems, uniform exponential stability 
and uniform asymptotic stability are equivalent. That is, an equilibrium is uniformly exponentially 
stable if and only if it is uniformly asymptotically stable. For a straightforward proof of this, see 
Rugh !Ml Theorem 6.13]. 

The above definitions characterize stability in terms of the boundedness and convergence of 
solutions. In order to establish stability without explicit knowledge of such solutions, we look to 
Lyapunov's Second (Direct) Method. 



Definition 2.5. V : M" ^ M is a Lyapunov function for (2.1 1 if 

(i) V{x{t)) > with equality if and only if x = 0, and 

(ii) V{x{t)) < 0. 

This leads to the celebrated theorem of A.M. Lyapunov [23] . 



Theorem 2.1 (Lyapunov's Second Theorem on M). Given system (2.11 with equilibrium x — 0, 
if there exists an associated Lyapunov function V , then x — Q is Lyapunov stable. Furthermore, if 
V{x{t)) < 0, then x = is asymptotically stable. 

The power of this theorem is that one can deduce stability properties of solutions without direct 
knowledge of the solutions. We will discuss some techniques for finding suitable Lyapunov functions 
in the next few subsections. 
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2.1. The Continuous-time Algebraic Lyapunov Equation. To satisfy the requirements of 
Theorem 2.1 for asymptotic stability, we seek a Lyapunov function, V , such that (a) V{x) > 0, with 
V{x) < for X ^ 0, and (b) V^(0) — V{0) = 0. For the system (2.1 ), a common choice of Lyapunov 
function candidate is the quadratic form, V{x{t)) = x^ {T)Px{t). We begin investigation of the 
stability of (2.1) by considering the time derivative of V{x): 

V{x{t))=f^[x^{t)Px{t)] 

= x'^{t)Px{t) + x^{t)Px{t) 
= x'^{t)PA{t)x + {A{t)xYPx{t) 
= x'^{t)PA{t)x + x^A^{t)Px{t) 
= x^{t)[A^{t)P + PA{t)]x{t). 

The quadratic form of this derivative proves useful because if the central quantity satisfies 

A^{t)P+PA{t) < 0, 

then V{x{t)) < 0. Thus, for our purposes it is sufficient to seek a P G which satisfies the algebraic 
Lyapunov equation 



A^{t)P + PA{t) = -M{t), 



(GALE) 



where M{t) G 5+ is given. Here, 5+ {S^) denotes the set of real, nx n positive (negative) definite 
symmetric matrices. 

To distinguish this from other Lyapunov equations, we refer to (GALE I as the continuous-time 
algebraic Lyapunov equation. The following theorem establishes a closed form solution of (GALE I. 

Theorem 2.2. [TJ [55] The unique solution of 

A^{t)P + PA{t) = ~M{t), 

is given by 



Pit) - / 



^l{s,to)M{t)<i>A{s,to)ds, 



(2.2) 



where ^A{t,tQ) is the transition matrix for system (2.1l, i.e., ^A{t,to) solves 

X{t) = A{t)X{t), Xito)^I. 
Moreover, P G 5+ whenever M{t) G 5+. 



Corollary 2.3. When A{t) = A and M{t) = M, the unique solution of (GALE I is the constant 



which converges when Re A < for all A G spec A. 

Note that it is the quadratic form of the solution that allows us to conclude M G 5+ implies 
P G 5+. It follows that existence of the quantity in (2.2 1 implies the existence of a Lyapunov 
function satisfying the requirements of Theorem 2.1 and ensures stability of system (2.1). Thus, 
( GALE ) straightforwardly leads to a viable Lyapunov function that we seek for a stability analysis 
of the underlying system (2.1). 
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2.2. The Continuous-time Differential Lyapunov Equation. On the other hand, suppose we 
seek a Lyapunov function of the form V{x{t)) — {t)P(t)x{t), the emphasis being that P is time 
varying. Then 

v{x{t)) = jy{t)p{t)x{t)] 

= x^ {t)[P{t)x{t) + P{t)x\ + x^P{t)x{t) 
= x^ {t)[P{t)A{t)x + P{t)x\ + {A{t)xfP{t)x{t) 
= x'^{t)[P{t)A{t)x + Pit)x] + x'^A^{t)P{t)x{t) 
= x'^{t)[A'^{t)P{t) + Pit)A{t) + P{t)]x{t). 

The quadratic form of this derivative proves useful because, if the central quantity satisfies 

A^{t)P{t) + P{t)A{t) + P{t) < 0, 

then V{x) < 0. Thus we seek a P(t) G which satisfies the differential Lyapunov equation 

A'^{t)P{t) + P{t)A{t) + P{t) = -M{t), (CDLE) 

where M{t) G 5+ is specified. 



To distinguish this from other Lyapunov equations, we refer to (CDLE I as the continuous-time 



differential Lyapunov equation. The following theorem establishes a closed form solution of (CDLE) 
Theorem 2.4. The unique solution of 

A'^it)Pit) + P{t)A{t) + P{t) = -M{t), Pito) = Po, 

is given by 



P(i) = (<i>5(t,io))"'P(M(*A(i,<o))" 



<i>lit,s)M{s)<^A{t,s)ds, 



(2.3) 



to 



where ^A{t, to) is the transition matrix for system (2.11. Moreover, P{t) G whenever M(t) G iS^. 



Remark 2.5. From the derivation of (CALEl, we see that the constant solution of (CALE) is 



in fact a steady state solution of (CDLE I provided the initial condition P{to) is chosen to be this 
constant solution of ( CALE ) . 



In light of the remark above, it is not surprising that (CALEl takes precedence over (CDLE I in 



the literature — matrix a/geferazc equations are much easier to solve than matrix differential equations. 



Even so, (CDLE I is an interesting problem in its own right. There are problems in which the time 



varying nature of a system makes ( CDLE ) useful, especially in the context of periodic systems [TJ [T5] . 
However, when the time dependence is not of interest, or has minimal impact on the system (e.g., 
slowly time varying systems), it is more efficient to consider the algebraic equation (CALEl to obtain 
simpler, steady state solutions of the differential equation (CDLE I. 



3. Stability of Discrete-time Systems 



We now turn our attention to the discrete analogue of the continuous system (2.1 1 analyzed in 
the preceeding section. Let t G Z and consider the discrete linear system 

Ax{t) = A{t)x{t), (3.1) 

for A G M"^", and t E Z, where Ax{t) :— x{t + 1) — x{t) is the usual forward difference operator. 



Rearranging (3.1) and defining Aji(t) := A(t) + 1, we can write (3.11 in its (possibly more familiar) 



equivalent recursive form 

x{t+l) = AR{t)x{t). 

We begin with several characterizations of stability. We include these in order to compare our 
generalized results in the next section to the standard results in the continuous and discrete settings. 
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Definition 3.1. Let t G Z. An equilibrium x = of (3.1 1 is Lyapunov stable or stable in the sense of 
Lyapunov if, for every e > 0, there exists a, S = d{e) > such that if ||a;(to)|| < <5, then ||x(i)|| < e, 
for every t > to. An equilibrium a; = of ( |3.1[ ) is called uniformly stable if there exists a finite 
positive constant 7 such that for any to and xq the corresponding solution satisfies 

Mt)\\<iM, t>h- 



Definition 3.2. Let t e Z. An equilibrium x = of (3.1 1 is asymptotically stable if it is Lyapunov 
stable and there exists a ^ > such that if ||a;(io)|| < S, then limt^oo ||a^(^)|| = 0. Furthermore, an 
equilibrium a; = of (3.1 1 is uniformly asymptotically stable if it is uniformly stable and if given any 
positive constant 6 there exists a T such that for any t^ and Xq the corresponding solution satisfies 

\\xit)\\ < 6\\xo\l t>to + T. 



Definition 3.3. Let t £ Z. An equilibrium a; = of ( 3. 1 ) is exponentially stable if it is asymptotically 
stable and there exist constants 7, (5 > and < A < 1 such that if ||x(io)|| < S, then 

\\x{t)\\<\\x{tom\'''", t>to. 



Furthermore, x = of (3.1 1 is uniformly exponentially stable if there exist finite positive constants 
7 and < A < 1 such that for any to and xq the corresponding solution satisfies 

\\x{t)\\<\\xito)\\^X'-*\ t>to. 



With the goal of analyzing stability of (3.1 1 without explicit knowledge of solutions, we explore 
the application of Lyapunov 's Second Method in the context of discrete-time systems. 



Definition 3.4. V{x) : M" ^ M is a Lyapunov function for system (3.1 1 if 

(i) V{x) > with equality if and only if a; = 0, and 

(ii) AV{x{t)) < 0. 



Theorem 3.1 (Lyapunov's Second Theorem on Z). Given system (3.11 with equilibrium x — 0, if 
there exists an associated Lyapunov function V{x), then x — is Lyapunov stable. Furthermore, if 
AV(x(t)) < 0, then x = is asymptotically stable. 

3.1. The Discrete-time Algebraic Lyapunov Equation. We begin with the same choice of 
Lyapunov function candidate utilized in the continuous case, V{x) — x'^ {t)Px{t). Then 

AV{x{t)) = V{x{t+1)) - V{x{t)) 

= x^{t + l)Px{t + 1) - x'^{t)Px{t) 

= x^{t){A{t) + lfP{A{t) + I)x{t) - x^{t)Px{t) 

= x^{t)[{A{t) + lfP{A{t) + /) - P]x{t) 

= x'^{t)[A{t)P + PA{t) + A{t)PA{t)]x{t). 

If the central quantity satisfies 

A{t)P + PA{t) + A{t)PA{t) < 0, 

then AV{x) < 0. Therefore, we seek a P(t) e satisfying the discrete-time algebraic Lyapunov 
equation, 

A{t)P + PA{t) + A{t)PA{t) = -M{t), (DALE) 

for a given M{t) e S+ . 

Equivalently, ( DALE I also has the recursive form 

Al{t)PAR{t) - P = -M{t), (DALEr) 

where Afi(t) := A(t) + I. This form seems to be more common in the literature on Lyapunov analysis 
of discrete linear systems UHl 133 • 

The following theorem establishes a closed form solution of ( CALE ) . 
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Theorem 3.2. [IJ[28] For A{t) = A andM{t) = M, the unique solution of (DALErl is the constant 



Moreover, P G whenever M G . The sum converges provided |A| < 1 for all A G spec A. 

3.2. The Discrete-time Difference Lyapunov Equation. Again, if we start with a Lyapunov 
candidate of the form V{x{t)) — {t)P{t)x{t), we obtain 

l^V{x{t)) = V{x{t+l)) - V{x{t)) 

= x^{t + l)P{t + l)x{t + 1) - x'^{t)P{t)x{t) 

= x^{t){A{t) + lfP{t + l){A{t) + I)x{t) - x^{t)P{t)x{t) 

= x^{t) [{A{t) + lfP{t + \){A{t) + /) - P{t)]x{t) 

= x^{t) [A{t)P{t + 1) + P{t + l)A{t) + A{t)P{t + l)A{t) + AP(t)]x(t). 

If the central quantity satisfies 

A{t)P{t + 1) + P{t + l)A{t) + A{t)P{t + l)A{t) + AP(i) < 0, 

then Ay(x) < 0. Therefore, we seek a P{t) G satisfying the discrete-time difference Lyapunov 
equation, 

A{t)P{t + 1) + P{t + l)A{t) + A{t)P{t + l)A{t) + AP{t) = -M{t), (DOLE) 
for a given M(t) G . This equation is more often seen in a recursive form 

^R{t)P{t + l)^fl(i) - P{t) = ~M{t)- (DDLEr) 



To show stabihty of system (3.1 1 via Theorem 3.1 we begin by solving (DDLE) for P{t) 



Theorem 3.3. |31j The unique solution of (DDLE I satisfying Pito) — Pq is given by 



P{t) = {<^>l{t,to))-^P{to){^A{t,to))-' - <^l{s,t)M{s)<^>A{s,t), 



(3.2) 



where ^Ait,to) is the transition matrix for ( |3.1[ ), i.e., <i>yi(i, ^o) solves 

AX{t) = A{t)X{t), X{to)^L 
Moreover, P(t) G whenever M{t) G . 



Remark 3.4. From the derivation of (DALE I, we see that the constant solution of (DALE I is 



in fact a steady state solution of (DDLE I provided the initial condition P(io) is chosen to be this 
constant solution of (DALE I. 



(DDLE I and its corresponding solution are most useful for stability analysis of linear systems 



when the time dependent nature of the equation is relevant. For example, (DDLE) is frequently 



seen in the context of the analysis of discrete periodic systems [21 El 132] • However, when the time- 
dependent aspect is not of interest (e.g., A{t) = A ox A slowly time varying), it makes sense to 
simplify the problem (as we did in the continuous case) to an algebraic problem by seeking steady 



state solutions of ( DDLE ) 



4. A Unified Approach to Lyapunov Stability 

Now we turn our attention to generalizing the previous concepts from M and Z to more general 
time domains (time scales), e.g. nonuniform discrete sets or sets with a combination of discrete 
and continuous components. We begin with a brief overview of time scales and the prerequisite 
time scale calculus needed in order to examine generalized Lyapunov equations, their solutions, and 
properties of solutions in this framework. 
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Table 1. Canonical time scales compared to the general case. 





conti n uous 


(uniform) discrete 


time scale 


domain 


M 


z 


T 










forward 
jump 


cr(i) = t 


a{t) =t+l 


a{t) varies 


step size 


flit) = 




fi(t) varies 


differential 
operator 


x{t + h)-x{t) 
x(t) := lim 


Ax{t) := x{t + 1) - x{t) 


^^^^^^ x{t + f,{t)) ^ x{t) 


canonical 
eq uation 


x(t) = Ax{t) 


Ax{t) = Ax{t) 


x^{t) = Ax{t) 


LTI stability 
region in C 































4.1. What Are Time Scales? The theory of time scales springs from the 1988 doctoral dissertation 
of Stefan Hilger that resulted in his seminal paper [T7|. These works aimed to unify various 
overarching concepts from the (sometimes disparate) theories of discrete and continuous dynamical 
systems [25], but also to extend these theories to more general classes of dynamical systems. From 
there, time scales theory advanced fairly quickly, culminating in the excellent introductory text by 
Bohner and Peterson [5] and the more advanced monograph (6j. A succinct survey on time scales 
can be found in [2]. 

A time scale T is any nonempty, (topologically) closed subset of the real numbers M. Thus time 
scales can be (but are not limited to) any of the usual integer subsets (e.g. Z or N), the entire real 
line M, or any combination of discrete points unioned with closed intervals. For example, if g > 1 is 
fixed, the quantum time scale is defined as 

9^ {g'^ : e Z} U {0}. 

The quantum time scale appears throughout the mathematical physics literature, where the dynam- 
ical systems of interest are the g-difference equations |H H] . Another interesting example is the 
]}ulse time scale Pa,b formed by a union of closed intervals each of length a and gap h\ 

Fa.& :=|J[A:(a + 6),fc(a + 6)+a]. 

This time scale is used to study duty cycles of various waveforms. Other examples of interesting 
time scales include any collection of discrete points sampled from a probability distribution, any 
sequence of partial sums from a series with positive terms, or even the infamous Cantor set. 

The bulk of engineering systems theory to date rests on two time scales, K and Z (or more 
generally /iZ, meaning discrete points separated by distance K). However, there are occasions when 
necessity or convenience dictates the use of an alternate time scale. The question of how to approach 
the study of dynamical systems on time scales then becomes relevant, and in fact the majority of 
research on time scales so far has focused on expanding and generalizing the vast suite of tools 
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Table 2. Differential operators on time scales. 



time scale 


differential operator 


notes 


T 


^A^-^\ _ x(ij(t))-x{t) 
^ tj.{t) 


generalized derivative 


M 


x^(i)-lim,^o"^*+'r"^*^ 


standard derivative 


Z 


a;^(i) = Ax{t) := x{t + 1) - x{t) 


forward difference 


hZ 


x^{t) = A;,x(t) -(*+'»^)--(*) 


/i-forward difference 




xA(t) = A,:r(t) 


g-difference 


Pa,6 




pulse derivative 



available to the differential and difference equation theorist. We now briefly outline the portions of 
the time scales theory that are needed for this paper to be as self-contained as is practically possible. 

4.2. The Time Scales Calculus. We now review the time scales calculus needed for the remainder 
of the paper. 

The forward jump operator is given by a{t) := mfs^j{s > t}, while the backward jump operator 
is p(t) :— swpgi:j{s < t}. The graininess Junction is given by := a{t) — t. 

A point < G T is right- scattered if a{t) > t and right dense if a{t) — t. K point t S T is 
left-scattered if p{t) < t and left dense if p{t) — t. If t is both left-scattered and right-scattered, we 
say t is isolated or discrete. If t is both left-dense and right-dense, we say t is dense. The set is 
defined as follows: if T has a left-scattered maximum m, then T'' = T — {m}; otherwise, T'^ = T. 

For / : T ^ M and t , define f^{t) as the number (when it exists), with the property that, 
for any e > 0, there exists a neighborhood U of t such that 

\[fi<jit))-fis)]-f^{t)[ait)~s]\<e\a{t)^sl Vs G C/. (4.1) 
The function : T" — ^ M is called the delta derivative or the Hilger derivative of / on T''. 



Equivalently, (4.1 1 can be restated to define the A-differential operator as 

^ _ x{a{t)) - x{t) 

^ ^ - Kt) ' 

where the quotient is taken in the sense that fi(t) 0+ when /i(t) = 0. 

A benefit of this general approach is that the realms of differential equations and difference 
equations can now be viewed as but special, particular cases of more general dynamic equations on 
time scales, i.e. equations involving the delta derivative(s) of some unknown function. See Table [2] 

Since the graininess function induces a measure on T, if we consider the Lebesgue integral over 
T with respect to the /i-induced measure, 

/ md^l{t), 

Jt 

then all of the standard results from measure theory are available [TB]. In particular, under mild 
technical assumptions on the integrand, we obtain the set of integral operators in Table |3] 

The upshot here is that the derivative and integral concepts (and all of the concepts in Table [ij 
apply just as readily to any closed subset of the real line as they do on K or Z. Our goal to leverage 
this general framework against wide classes of dynamical and control systems. Progress in this 
direction has been made in transforms theory [TT1I21], control [TnUHllIS], dynamic programming 
pg] . and biological models [TOjl^. 
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time scale 


integral operator 


notes 


T 




generalized integral 


M 




standard Lebesgue integral 


Z 




summation operator 


KL 




/i-summation 






g-summation 



The function p : T ^ M is regressive if 1 + fi{t)p{t) ^ for all t eT'^. We define the related sets 
TZ := {p -.T : p e G,d{V and 1 + ^i{t)p{t) ^ for all t e T'"}, 
7^+ := {p e 7^ : 1 + nit)p{t) > for all t e T"}. 

For pit) e TZ, we define the generalized time scale exponential function ep(t,io) as the unique 
solution to the initial value problem x^{t) = p{t)x{t), x{to) = 1, which exists when p £TZ. See pi . 

Similarly, the unique solution to the matrix initial value problem X^{t) = A{t)X{t), X(to) = / 
is called the transition matrix associated with this system. This solution is denoted by ^o) and 

exists when A € TZ. A matrix is regressive if and only if all of its eigenvalues are in TZ. Equivalently, 
the matrix A{t) is regressive if and only if / + ii{t)A{t) is invertible for all t G T*^. 

4.3. Stability of Dynamic Systems on Time Scales. Let T be a time scale, unbounded above 
with bounded graininess. We consider the dynamic linear system 

x'^it) = A{t)x{t), (4.2) 

for A{t) e 7?.(E"^"), and t £T, where x^ is the generalized A-derivative. Notice that (4.2 1 reduces 



to the familiar systems in (2.11 and (3.11 when T = K and T = Z, respectively. Having seen 



how Lyapunov's Second Method allowed us to analyze stability of these systems on the familiar 



continuous and discrete domains, we would now like to apply this method to the analysis of (4.2 1 
defined on an arbitrary time scale. 

In 2003, Potzsche, Siegmund, and Wirth |27] developed spectral criteria for the exponential 



stability of (4.2) in the scalar case and in the case that A{t) = A. Then DaCunha [S] extended 
these results by adapting the Second Method of Lyapunov to the analysis of a certain class of 
nonautonomous linear systems (slowly time varying systems) defined on time scales. Here we will 
explore and further extend those results, ultimately developing and solving a time scale dynamic 
Lyapunov equation which unifies the familiar Lyapunov equations on K and Z and is applicable to 
a much broader class of systems than those DaCunha studied. 

We begin by giving generalized characterizations of stability for dynamic linear systems on time 
scales and then review a few necessary results from existing theory. 



Definition 4.1. For i G T, an equilibrium a; = of (4.2) is Lyapunov stable or stable in the sense of 
Lyapunov if, for every e > 0, there exists a. 6 — S{e) > such that if ||a;(to)|| < S, then ||a;(t)|| < e, 
for every t > to. An equilibrium a; = of ( |4.2[ ) is called uniformly stable if there exists a finite 
constant 7 > such that for any to and x{to), the corresponding solution satisfies 

\\x{t)\\ < j\\x{to)\\, t>to. 



Definition 4.2. For t G T, an equilibrium a; = of (3.1) is asymptotically stable if it is Lyapunov 



stable and there exists a, S > such that if ||a;(to)|| < S, then limf^oo ||2;(i)|| = 0. Furthermore, an 
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equilibrium a; = of (3.1 1 is uniformly asymptotically stable if it is uniformly stable and if given any 
(5 > there exists a T > such that for any to and x(io) the corresponding solution satisfies 

\\x{t)\\ < 6\\x{to)\l t>to + T. 



Definition 4.3. For < G T, an equilibrium a; = of (3.1 ) is exponentially stable if it is asymptotically 
stable and there exist constants 7, A, (5 > with —A G 7?.+ such that if ||a;(io)|| < S, then 

\\xm <je^x{t,to)\\x{to)\\, t>to. 

Furthermore, x = of ( |3.1| is uniformly exponentially stable if there exist 7, A > with — A G TZ^ 
such that for any to and x(to), the corresponding solution satisfies 

\\xm < \\x{to)\he^x{t,to), t>to. 



These characterizations of stability for system ( |4.2| are generalizations of the corresponding 
characterizations of stability for systems defined on M and Z. Specifically, the condition that --A G 
TZ'^ in the characterization of uniform exponential stability reduces to A > and < A < 1 for 
T = M and T = Z, respectively. 

A necessary and sufficient condition for the stability of (4.2 1 (in the scalar case) is given via the 
following theorem. 

Theorem 4.1. |27j Let T be a time scale which is unbounded above and let X C. Then the scalar 
equation 

x^{t) = Xx{t), x{to) = .To, 
is exponentially stable if and only if one of the following conditions is satisfied for arbitrary to G T; 

1 



(i) 7(A) 



lim sup ■ 



lim i^^^^A.<0, 



to Jto «\M(t) S 

(ii) For every T G T, there exists a t €T with t > T such that 1 + /i(t)A = 0, 
where we use the convention logO = — cxd in (i). 

They then define the set of exponential stability accordingly, as the collection of A G C satisfying 
condition (i) or (ii) above. 



Definition 4.4. 



Given a time scale T which is unbounded above, define for arbitrary to G T, 



5c (T) 



A G 



1 



lim sup 

T^oo T — ta Jf.^ s\tj,{t) 



lim ^"g'^ + -^'At<0 



and 



5k(T) := {A G M : VT G T 3t G T with t > T such that 1 + ^{t)\ 
Then the set of exponential stability for the time scale T is defined by 

5(T) :=5c(T)u5k(T). 



0}. 



be regressive. 



Theorem 4.1 extends to the time invariant matrix case, A{t) = A a.s follows. 

Theorem 4.2. |27j Let T be a time scale that is unbounded above and let A Cz R 
Then the following hold: 

(i) If the system (4.2| is exponentially stable, then spec(A) C 5c(T). 

(ii) If all eigenvalues A of A are uniformly regressive, {i.e., 37 > such that-f-^ > \l + fi{t)X{t)\, 
t G T) and if apec{A) C 5c(T), then (4.2) is exponentially stable. 

However, this theorem has limitations in practice as the set S can be difficult to compute for 
an arbitrary time scale. To overcome this, for each fixed t £ T, define the (open) Hilger circlcj^via 



n 



z G 



z + 



< 



Kt)] 



^More appropriately, the Hilger disk, but this abuse of language is estabUshed in the literature now. 
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HofFacker and Gard [13] showed that, if < < /imax for all ^ G T, then there is a region 

'^min C 5c, corresponding to /x^ax and given by 



'^min ■ 1 ^ ^ 



Z + 



Ml, 



< 



This yields a static stability region that is more easily calculable than 5c, albeit more conservative. 
We conclude that spec A C Timin is a sufficient (but not necessary) condition for the stability of 
( [0| when A{t) = A. 

Having established the above results for the scalar and autonomous cases, we turn our attention 
back to the general case. In order to extend Lyapunov's Second Method to dynamic equations on 
time scales, we define a time scale Lyapunov function and give a unifying generalization of Theorems 
lOandIO 

Definition 4.5. A function V : M" ^ M is called a generalized or time scale Lyapunov Junction for 
system if 

(i) V{x) > with equality if and only if x = 0, and 

(ii) V^{x{t)) < 0. 



Theorem 4.3 (Lyapunov's Second Theorem on T, [2T1|22]). Given system (3.11 with equilibrium x = 
0, if there exists an associated Lyapunov function V(x), then x — is Lyapunov stable. Furthermore, 
if V^lxlt)) < 0, then x — is asymptotically stable. 

4.4. The Time Scale Algebraic Lyapunov Equation. We begin with the quadratic Lyapunov 
function candidate V{x{t)) = x^ {t)Px{t) . Differentiating with respect to t G T yields 

V^{x{t)) = [x'^Px]^ 

= (x^P)a;^ + (a;^F)^a;" 

= x'^PA{t)x + x^A^{t)P{I + n{t)A{t))x 

= x'^[A^{t)P + ^l{t)A'^{t))PA{t)]x 

= x'^[A^{t)P + PA{t) + ^lit)A^it)PA{t)]x. 

If the central quantity satisfies 

A^{t)P + PA{t) + n{t)A^{t)PA{t) < 0, 

then V^ixit)) < 0. Therefore, we seek a solution P{t) G to the time scale algebraic Lyapunov 
equation 

A^{t)P + PA{t) + ^i{t)A^{t)PA{t) = ~M{t), (TSALE) 

for a given M{t) G 5+. 

This algebraic equation unifies the matrix algebraic Lyapunov equations on M and Z discussed 
ear lier: (|TSALE[ ) reduces to ( |CALE| ) on T = M and ( |DALEp on T = Z. However, t he solu tions 
to (TSALE I on an arbitrary time scale are fundamentally different than solutions to (GALE I and 
(DALE I — they are generally time varying. 

Theorem 4.4 (Glosed Form Solution of ( |TSALE| ), f9]). For each fixed t G T, define 



The unique solution of (TSALE I is given by 



P{t)= f <^'^{s,0)MmA{s,0)As, 

JSt 



(4.3) 



which converges provided A G 7Y,nin for all A G spec A and all t>T. Moreover, P{t) G whenever 
M{t)eS+. 
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The upshot here is that even though (4.3 1 is a bona fide solution to (TSALEl, it does not (in 
general) lead to constant solutions P — and P was assumed to be constant in the Lyapunov candidate 
at the start of this subsection. Thus, (TSALEl is not a "legitimate" Lyapunov equation in the sense 
that it is not an appropriate equation to use in a search for Lyapunov function candidates (even 
when A(t) = A). We are forced to seek a Lyapunov function candidate with a time varying P, which 
we do next. 

4.5. The Time Scale Dynamic Lyapunov Equation. We begin with the same choice of qua- 
dratic Lyapunov function candidate, V{x{t)) = {t)P{t)x{t). Differentiating with respect to t €T 
yields 

V^ixit)) = [x^{t)P{t)x{t)]'^ 

= {x'^P{t))x^ + {x'^P{t))^x'' 

= x^P{t)A{t)x + [{x'^)'^P{t) + {x'^YP^{t)]x'' 

= x^P(t)A{t)x + {x^A^P{t) + x^(l + ^L{t)A{t)fP^(t)\{I + ii(t)A(t))x 
= x^\A^(t)P{t) + (/ + ii{t)A^{t)){P^{t) + P{t)A(t) + ii{t)P^(t)A(t))\^ 
= x^\A^(t)P{t) + P(t)A(t) + ii{t)A^(t)P(t)A(t) 

+ (/ + ii{t)A^{ty)P^m + A*(i)A(i))]x. 

If the central quantity satisfies 

A^{t)P{t) + P(t)A{t) + ii(t)A^(t)P(t)A(t) + (/ + pi{t)A^{t))P^{t){I + [i(t)A{t)) < 0, 

then < 0. Therefore, we seek a solution P{t) G of the time scale dynamic Lyapunov equation 

A^{t)P{t) + P{t)A{t) + fi{t)A^{t)P{t)A{t) 

+ {!+ fi{t)A^{t))P^{t){I + Kt)A{t)) - ~M{t), 

for a given M(t) G . This equation unifies the matrix differential and difference Lyapunov 
equations on M and Z discussed earlier: (TSDLE) reduces to (CDLEl on T = M and to (DDLE) on 
T = Z. Just as importantly, (TSDLE I also generalizes those types of equations to arbitrary time 
scales. 



(TSDLE) 



Theorem 4.5 (Closed Form Solution of (TSDLE I ). The unique solution of 
A^{t)P{t) + P{t)A{t) + ii{t)A^{t)P{t)A{t) 

+ (/ + ^Ji{t)A^{t))P'^{t){I + ^i{t)A{t)) = -M{t), Pito) 

is given by 

Pit) = {^lit,to))-'Pito)i^A{t,to)r' 



i^Ait,to)y 



^l{s,to)M{s)^A{s,to)As 



{^A{t,to)y 



(4.4) 



where <I>^(f, io) is the transition matrix for (3.1 1. 



Proof. For ease of presentation, we will at times suppress the t dependence in our notation. Consider 

A'^P + PA + fiA'^PA +{! + nA^)P^{I + fiA) = -M{t). 
Multiply on the left and right by ^\{t, to) and ^A{t, to), respectively, to obtain 
$5(i, to) [A'^P + PA + nA^PA + {! + tiA'^)P^{I + fiA)] <i>A{t, to) 

= -<i>l{t,to)M{t)<i>A{t,to). 

Recognizing the left-hand side of the above equation as a derivative. 



[<^lit,to)pmA{t,to)y 



-^l{t,to)M{t)^A{t,to), 
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and integrating yields 

to)PmA{t, to) - P(io) - - / ^l{t, to)M to) 

Jto 

Rearranging, we obtain 

Pit) = i^l{t,to))-'Pito)i^A{t,to))-' 



At. 



i<(.t,to))~' 



<i>l{s,to)M{s)<i>A{s,to)As 



{<i>A{t,to))-\ 



□ 



Remark 4.6. We have already seen that (TSDLE) is a generalized form unifying the Lyapunov 
equations (CDLE) and (DDLEl for systems on M and Z, respectively, and extending them to arbi- 



trary time domains. Equation (4.4 1 is also a generalized form unifying the solutions of (CDLE) and 



(DDLE 


1 since ( 


4.4 1 becomes (2.3 


1 on R and ( 


3.2 



Remark 4.7. At this point, we see how the analysis diverges from that of K and Z: the solution 



of (TSALEl is time varying even when A{t) = A and M{t) = M are constant, since the domain 
of integration in the solution depends on Only when operating on time scales of constant 

graininess, such as K, Z, and T = /iZ, is the solution of (TSALEl constant. On M and Z, (4.3 1 



agrees with the solutions of (GALE I and (DALE I and gives a steady state solution of (CDLE) and 



(DDLEl as desired. However, on an arbitrary T, (4.3 1 is not a stationary solution of (TSDLE I 



because P(t) is not constant. 

This underscores a crucial difference between algebraic Lyapunov equations on general time 
scales versus their M and Z counterparts: only when the time scale has constant graininess is a 
solution to an algebraic Lyapunov equation also a (stationary) solution to the dynamic Lyapunov 
equation. 



4.6. Further Notes on (TSDLEl. For a given dynamic linear system (4.2) and choice of initial 
condition Pq, the closed form solution of (TSDLEl is known. However, in order for V{x) = P{t)x 



to be a Lyapunov function, we must know the existence of a solution P{t) in the appropriate space 



of functions, namely iS+. It is not clear that P{t) is in fact positive definite from its form in (4.4) 
This obstacle is overcome by making a special choice of initial condition. 



(4.5) 



Theorem 4.8. In Theorem \4-^ if the initial condition is 

nOO 

P{to) = Po:= / to)M{s)^A{s, to) As, 

Jtn 



then (4.4 1 becomes 

Pit) 

and M{t) £ S+ implies P{t) e S+ . 



<i>l{s,t)M{s)<i>A{s,t)As, 



(4.6) 



Proof. The solution of (TSDLEl given in (4.4| holds for an arbitrary choice of P{to). Making the 
specific choice of Po given in (4.51 allows the following simplification: 



P{t) = {<i>l{t,to))~'P{tQ){<i>A{t,to))'' 



i^Ait,to))~' 



^l{s,to)M{s)^Ais,to)As 



{^A{t,to))-' 
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may be written as 

P{t) ^ {^l{t,to))-' 



^l{s,to)M{s)<^A{s,to)As 



to 



{^A{t,to)r' 



$5(s,to)M(s)$^(s,to)As 



{^A{t,to))-' 



to)^l{s, t)M{s)<^>A{s, t)<^>A{t, to) As 

/oo 
^l{s,t)M{s)<i>A{s,t)As. 

From the resulting quadratic form of P{t), we see M{t) e 5+ implies P{t) E S^. □ 

Remark 4.9. The choice of initial condition given in Theorem |4.8| is necessary. Choosing any other 
initial condition results in (4.4 1 being unbounded. For P(to) = Pq + e, (4.4) becomes 

P(t) = {<^>l{t, to))-HPo + e){^A{t, to))-' 



i^Ait,to))-' 



^l{s,to)M{s)^Ais,to)As 



{^A{t,to))'' 



{<i>l{t,to))''e{^A{t,to))"' + {^l{t,to))'\Po){^A{t,to))-' 



i'^lit,to))- 



<i>l{s,to)M{s)^A{s,to)As 



{'^Ait,to))- 



= {<^l{t,to))-'e{^A{t,to))-' + <^l{s,t)M{s)<fA{s,t)As. 

For stable, constant A, ^Ai^, t) is a decaying matrix exponential. Thus while the integral term may 
converge, the quantity || (<i>^(i, to))^"^e(<i>A(i, ^o))""^ II — *■ oo as i ^ oo. 

Remark 4.10. With this choice of initial condition, P{t) reduces to a useful form, especially for 
aligning our results with the literature, at least in the following sense. If T has constant graininess, 
to — 0, and M is constant, then the initial matrix Pq in (4.5) is in fact a (constant) solution of 
(TSALEl which is in turn a stationary solution of (TSDLEl. Therefore, precisely this choice of 
initial matrix (under the assumptions above) produces steady-state solutions of ( [TSDLE I from its 
algebraic counterpart (TSALEl. This is what happens on M and Z but fails on general time scales. 



Remark 4.11. On the other hand, the form of (4.6 1 allows us to deduce P{t) € 5+ whenever 
M{t) e which is essential if we want to apply Theorem 4.3 For such a solution P{t), we know 
V{x) :— x^P{t)x > and V'^{x) < 0. Therefore, the existence of (4.6) is sufhcient to estabhsh 
asymptotic stability of (4.2). 
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